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ABSTRACT 

The   relationship    between    the  weighting  matrices   and   the 
design    objectives    for    finite-final-time    linear    regulator 
systems    is    considered.      An    iterative   algorithm    is   presented 
for    selecting   a   weighting   matrix   that    reduces    the  absolute 
difference   between   the  actual    and   desired  values    of   a    vector 
design   measure.      The  algorithm  utilizes    the   sensitivities    of 
the   vector    design   measure    to   determine    changes    for    the 
weighting   matrix.      These   sensitivities    are  approximated  by 
finite-difference  perturbations    of    the   weighting   matrix 
elements.      Examples   are  presented   that    illustrate    the 
design  procedure. 
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I .       INTRODUCTION 

The   linear    regulator     is    one    of    the   most    extensively 
studied  and   well    known   problems    of    optimal    control    theory, 
L 1 , 2 , 3,4 j 556 ,7 58 J •      This    importance    stems    from    the   fact    that 
many   practical    control   problems    can    be    formulated    in    the 
linear    regulator    form.       Its    most    desirable    feature    is    that 
the   optimal    control    law   employs    linear    state- var iable   feed- 
back. 

A.       THE   GENERAL   LINEAR    REGULATOR    PROBLEM 

A   linear    regulator    problem  may   be   formulated  as    follows: 
Consider    a    completely    controllable,    completely    observable 
mult ivar iable   time-varying    dynamic    system 

x(t)    =   A(t)x(t)+B(t)u(t)  (1-1) 


and   the  performance    index 

J 


f(x(t)TQ(t)x(t)+uT(t)R(t)u(t))dt,       (1-2) 
0 


where    the   real    symmetric    nxn   weighting    matrices    Q( t )    and   H 
are   non-negative    definite,    and   the    real    symmetric    mxm   weighting 
matrix    R(t)    is   positive    definite.       x( t )     is    the   nxl    state    vector, 
u(t)    is    the   mxl    vector    of    controls,    B( t )     is    an    nxm   matrix,    A(t) 

is    an    nxn    matrix   and   the    final    time,    t     ,    is    fixed.       The    optimal 

*  r         1 

control    u    (t)    minimizes    J5    and    is    given    by    L1,2J 

*  -IT 

u    (t)    =    -R       (t)B    (t)K(t)x(t), 

(1-3) 
u*(t)    £    -    F*(t)x(t). 
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K(t)  is  the  nxn  positive  definite  symmetric  matrix  solution 
to  the  Riccati  equation 

K(t)  =  -AT(t)K(t)-K(t)A(t)-Q(t)+K(t)B(t)R_1(t)BT(t)K(t)   (1-4) 

with  the  boundary  condition 

K(tf)  =  H.  (1-5) 

Because    the    system    is   assumed   to  be   controllable  and 
observable,    it    is   possible    to  achieve   arbitrary    dynamics    with 
state-variable    feedback   L  7  J  »      The  practical   application    of 
optimal    linear    regulator    theory    to    system    design    leads    to 
the  problem    of    selecting    the   weighting   matrices.      The   state 
trajectory    of    the   optimal    system    given    by    the    solution    of 

x(t)    =    lA(t)-B(t)F*(t)Jx(t)  (1-6) 

is    dependent    upon    the   weighting   matrices    chosen.       It    is 
therefore   desirable   to    establish  a    relationship    between    the 
weighting   matrices    and   the    design    objectives    (such   as   percent 
overshoot,    time    to    overshoot    and   settling    time)    with    the    ob- 
jective  of    developing   a    design  procedure. 

B.       A    RESTRICTED  LINEAR    REGULATOR    PROBLEM 

This    thesis    considers    only    the    time- invar iant ,    single- 
input,    finite   final-time    (t      <  •  )    linear    regulator    problem. 
For    this    problem   A,    R,    and   Q  are    constant    matrices    and    B   is 
the   constant    nxl    vector    b. 


C.       LITERATURE    SURVEY 

None   of    the   literature   surveyed  proposes    a    systematic 
procedure    for    finding   a    suitable   weighting   matrix   Q   for    the 
finite   final-time  problem    (t      <   » ) .       The    infinite   final-time 
problem  has    been   considered   by    several   authors    l5>7,8J. 

The   most    extensively    used   method   for    selecting    a    suitable 
weighting   matrix    Q    is    to   make    an    educated   guess,    observe    the 
result,    and   update    the    guess.       The   major    fault    here    is    that 
there    is    no   guarantee    that    an    acceptable    Q   can    be    found    in    a 
feasible    number    of    trials. 

The   most    definitive  procedure    for    finding    Q    in    the    infi- 
nite final-time  problem   has    been    developed   by    Chen   and   Shen   L7J 
In    their    procedure  a   weighting   matrix    is    selected    to   yield  a 
set   of   desired  closed-loop    eigenvalues.      A   direct   relationship 
between    an    incremental    change    in    the    closed-loop    eigenvalues 
and    the   corresponding    change    in    the   weighting   matrix    Q    is 
established   using    Jacobi's    sensitivity    formula    and  perturbation 
of    the    steady-state    solution    of    the   Riccati    equations    (K    =   0). 
Two    iterative   algorithms    are    given    for    the    determination    of 
the    elements    of    the   weighting    matrix   Q. 

This   procedure   would   be    difficult    to    extend    to    the    finite 
final-time  problem   because   a    desired   set    of    time-varying    eigen- 
values   would   have    to   be    formulated.       It   was    felt    that    this 
extension   would   not    be   beneficial. 


A  different  approach  was  taken  by  Wakeland  in  his  doctoral 
dissertation  [8j.   He  considers  the  system  given  by 

e  =  Ae  (1-7) 

where    A    is    an    nxn    matrix    in   phase- var iable   form   [9]    and    e 

is    the    vector    difference    between    the    system   output    c    and   the 

desired   system   output    r_.      The  performance   criterion    used   is 


00 

=  J         eTQec 


J   =J        e   Qedt  (1-8) 

0 

where   Q    is    an    nxn    diagonal    matrix.       Wakeland's    empirical 

results    show    that    the   elements    of    the  weighting  matrix 

Q    =    diag     U,q22,q33,...,qnn]  (1-9) 

are    directly    related   to    the   slopes    of    the    elements    of    the 

cost    functional    with    respect    to    the   parameters    of    the   system 

matrix,    where    the   cost    functional    is    expressed   as 

00  ^-  °°  /-08 

J    -J        e'dt    +    q22   |o       e^dt    *,..t    qnJo      e'dt.  (1-10) 

The   weighting    matrix    elements    are    defined    in    terms    of    these 
slopes    for    second- , thir d-and   fourth-order    systems.       Analytic 
relationships    between    weighting   matrix    elements    and   system 
parameters    are    developed,    and   graphs    and    tables    that    repre- 
sent   these    relationships    for    second- , third-and   fourth-order 
systems    are   given.       These   graphs    and    tables    present    the    re- 
lationships   between    weighting    matrix    elements    and   certain 
time-response  performance   characteristics    such   as    overshoot 
and   settling    time. 
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Schultz  and  Melsa,  l5Jj  consider  the  infinite- t ime  problem 
(t   =  °o )  where  the  system  is  assumed  to  be  in  phase- var  iable 
form  and  show  that  the  cost  functional  given  by 

J  =J   (xT(t)Qx(t)+ru(t)2)dt  C 1-1-1} 


may    be   reduced    to 


J    = 


o     L 


(t))2+ru(t)2 


dt+xT(«s)Sx(»)-xT(0)Sx(0)  .       (1-12) 


_     .  .     .  th  th 

S    is    an    nxn    symmetric    constant    matrix   whose    n  row   and   n 

columns    are    set    to    zero,     in    order    to   make    the   reduction    in- 

T 
dependent    of    the    system    (A,b)„       Since    the    term,    x    (0)Sx(0), 

depends    only    on    the    initial    conditions,   _x(0)s     it    has    no 

T 
effect    in    the   minimization    of    J.       For    the    term,    x    (C0)Sx(a<>), 

to    have    no    effect,    the    system   must    be   asymptotically    stable. 

The   reduced  performance    index  has    only   n   weighting   factors 

to   be    considered  which   can    be   related   to   the   concept    of 

odeling  ,L  5.1  •      The    elements    of    the   weighting    vector,   y_}    for: 

the    coefficients    of   an    ( n-1 ) s t-or der    differential    equation 


m 


:m 


d      y 

V   v   +  y  v   +  V   v+ . . . +Y     - =  0 

ly        72y        73y    ""^n  dt(n-l) 


(1-13) 


which   must    be    satisfied  by    the    output    of    the   system    under 
consideration    to   minimize   J.      Therefore,    equation    (1-13)    is 
regarded  as    a   model    for    which   a    desired   response    is    formulated; 
the   model    is    adjusted   to   satisfy    classical    response    charac- 
teristics,   such    as    rise-time,    overshoot,    phase   margin,    and   so 
forth.      The   adjusted   coefficient    vector,    y_,    is    the   weighting 
vector    for    the   performance    index. 
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II.   FORMULATION  OF  THE  WEIGHTING-MATRIX  SELECTION  PROBLEM 

A.   INTRODUCTION 

The  basic   system   considered   is    a    controllable,    observable, 
mult ivar iable,    t ime- invar iant ,    single-input,    linear    dynamic 
system  given    by 

x(t)    =   Ax(t)    +bu(t).  (II-l) 


The  performance   index    to   be  minimized    is    given   by 

J  =  h)      (xT(t)Q2i(t)+  u2(t))dt.  (n-2) 

0 

The  optimal  control  that  minimizes  equation  (II-2)  is  given 
by 

u*(t)  =  -  bTK(t)x(t).  (H-3) 

K(t)    is    the   solution    to   the  reduced  Riccati    equation 

K(t)    =    -    ATK(t)-K(t)A-Q+K(t)bbTK(t),  (H-4) 

which  has  the  boundary  condition 

K(tf)  =  o.  (n-5). 

B.   TRANSFORMATION  TO  CANONICAL  FORMS 

It    was    decided,    from   a    computational    standpoint,    that    the 
number    of    non-zero   elements    of    the   Q  matrix    should   be    small. 
For    this    reason,    transformation    of    the  system   to   two   canonical 
forms    was    examined;    the    diagonal    state-matrix    form   and    the 
phase-variable   form. 
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A   system   that    has    no  multiple   eigenvalues    may    be   readily 
transformed   into   one   that    has    a    diagonal    A  matrix   by    the 
following   procedure.       The   system    has    a    column-par t ioned  matrix 
of    eigenvectors    given   by 


E   = 


e    e 
-1-2 


*] 


(H-6) 


where   each   eigenvector    e.    is    associated  with    its    eigenvalue 

—l 


X..      This    matrix   may    be   normalized   to 
1 


A 

A      A 

A 

E    = 

e    e    o 
-12 

■  .  e 
— n 

(n-7) 


by  normalizing  the  individual  eigenvectors  to  unit  magnitude 

A 

By  letting  x(t)    =   E_z(t),  the  new  system  is  given  by 


A(t)  =  A1£(t)+b1u(t) , 


(11-8} 


wher  e 


A.  = 


A  _1   A 

E   AE 


(II-9) 


and 


*i 


a_x 
E   b. 


(11-10) 


The  matrix   A,    has    the   form 


Ax     0     0 


Al    = 


0        A2   0 

o       o    A. 


.     o    A 


(ii-ii) 
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With   the   system    in    this    form,    a    diagonal   Q  matrix   may    be   used 
and   still    have    complete    influence    on    feedback;    but    the   elements 
of    the   matrix   A,    may    be    conjugate    complex.       This    requires    that 
all    computation    be   done   using    complex  arithmetic. 

Since   the   system   under    consideration    is    completely    con- 
trollable,   it    can   be   transformed   into   the  phase-variable  form 
with   a    linear    non-singular    transformation   matrix  T,    by    letting 
x   =  Tz   as    in   Rane   C 9 J .      This    leads    to   the  phase-variable   system 


z    =  ^   +  ^u 


where  the  system  matrix  has  the  form 


(11-12) 


A0    = 


0  10  0 
0  0  10 
0         0         0         1 


0.  . 

0.  . 


"ai    "a2 


0 

1 

-a 


(H-13) 


and   b      =    L00....0l].       The    elements    in    the  last    row    of   AQ 

(a.,    i   =    l,...,n)    are   the   coefficients    of  the   characteristic 

polynomial    for    the    original    system   matrix  A.       This    polynomial 
is    given   by 


n           n-1                 n-2 
s    +a    s        +a      ,  s        + +an  . 

n  n-1  1 


The    transformation    matrix   T    is    given    by 


(ii-i4) 


(n-15) 
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where  the  element  vectors  may  be  formed  by  the  recursive 
r  elations 

t   =  b 


t   .  =  At  +t  a 
— n-1     — n  — n  n 


t     =  At    +t  a 

— n - 2     — n  - 1  — n  n-1 


(11-16) 


li    =   At  +t  a 
— 1     — 2  — n  2 


C.       DIAGONAL I ZAT I ON   OF   THE    Q  MATRIX 

Kriendler,    [  l\\  ,    states    and  proves    the   following    theorem. 
If  a    linear    time-invariant   plant    is    in    the  phase-variable 
form,    then   for    any   positive   semidefinite  matrix  Q   in    the 
quadratic  performance    index 


=  h)      (xTQ2£ 


Qx+u    )dt 


(11-17) 


there   exists   a   unique   diagonal    matrix 

Q*   =   diagU11,q22J---.JClJn-l,qn,n] 

which    yields    the    same   optimal    control 


u    (t)    =    -    bTK(t)x(t) 


and    is    related    to   Q  by    the   formula 


(11-18) 


(11-19) 


q.  .     =    q..-2q.     .      .        +2q.     n     .     0- .  .  .  .  (11-20) 

Mn  Mn       Mi-l,i  +  l       Mi-2,if2  v  ' 

where    the   alternating    sum    is    continued   until    all    of    the   avail' 

able   q's    are   exhausted.      Even    though   Q   is    required   to   be 

positive    semidefinite,    Q      needed   not    be    so    restricted-      Let 

Q  be    the  positive    definite  matrix 


15 


Q  = 


10  0  2 
0  10 
2       0       1 


(11-21) 


Then 


Q      =    diag   ["10,-3,1] 


(11-22) 


where   Q      is    unique. 


It    should   be    noted   from  equation ( 11-20)    that    Q      does    not 
depend    on    the    elements    q. .    of    Q  where    i  +  j    is    an    odd   number. 
Therefore  when    the   system    is    in    the  phase- var iable   form,    an 
equivalent    matrix   Q      (simpler    than    Q)    may   be   considered, 
where    q    .  .    =    q.  .    if    i+i    is    even   and   q    .  .    =   0    if    is    i+i    odd. 
The  matrix   Q      retains    the  positive   definiteness    or    semi- 
definiteness    of    Q. 


The   optimal    feedback    control    law,   p_,    defined  by 

A       t 
p_   =    b  K(t), 


(II-23) 


th 


is    a    time-varying    row   vector    consisting    of    the   n         column 
of    the  Riccati   solution,    K,    for    a  plant    in  phase-variable 
form.       For    the    infinite-time  problem,    the   diagonal    weighting 
matrix   Q      is    unique   and   yields    the    same    feedback  p_  as    that 


corresponding    to    the    original    matrix   Q,    where 

T  T    * 

p   =    b  K      =   b  K    . 

■I—  05—00 


(II-24) 


D.   INITIAL  CONDITION  CONSIDERATIONS 

Designing  a  system  for  a  specific  initial  condition  does 
not  necessarily  produce  the  desired  time  response  for  other 
initial  conditions.   A  conservative  design  approach  is  adopted 
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here   by    assuming    that    worst-case    initial    conditions    occur. 

Worst-case    initial    conditions    are    defined  as    those  which 

maximize    the  minimum   value   of    the  performance    index   as    given 

by 

Jmin    =   *T(°)K(0)x(0).  (H-25) 

J  .   is  maximized  when  x(0)  is  colinear  with  the  eigenvector 
mm  — v  ' 

associated  with  the  largest  eigenvalue  of  K(0),[2J. 
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Ill .       PROBLEM    SOLUTION 

A.  SEARCH    IN    Q    SPACE 

The   most    direct    approach    to   selecting    the   weighting 
matrix,    Q,    would   be   to  perform   an    exhaustive   search,    evalu- 
ating  the   state   trajectory    for    each    of    several    selections 
of   Q.      Even    for    a    low-order    system,    this    is    a    formidable 
task . 

A  more   reasonable   approach    is    to   make  an    estimate   for    Q, 
evaluate   the   state   trajectory   and   then   change   Q  based   on    the 
closeness    of    the   state    trajectory    to    the   design    objectives. 
This   procedure    is    continued  until    the   state    trajectory    is 
acceptable.      As    this    requires    a    subjective   decision,    time- 
shared   computer    operation    is    a    necessity. 

B.  STATE-TRAJECTORY  SENSITIVITY 

The   sensitivity    of    the   state    trajectory   with   respect    to 

Qj    7?    5    can    be   evaluated   by    using    the    sensitivity    function 
aw 

approach.       This    involves    solving    the   Riccati    equation 

K    =    -    ATK-KA+KbbTK-Q  (III-l) 

with    the    boundary    condition 

K(tf)    =    0  (III-2) 

simultaneously  with  its  associated  sensitivity  equation 

d  (hK\_  AT  riK    dK     dK    T_,    V,,T    dK    dQ     /TTT   . 

dt^aof  '  A    ^q  "  dQA  +b~o  ^  K  +  K^    ao  "  Tq       (iii"3) 

with    the   boundary    condition 

dK(t    ) 

Tq-  =  0-  (iii"4) 
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Then  the  state  equation 

x  =  Ax  +  bu       x(°)  =  £0  (III-5) 

must  be  solved  simultaneously  with  its  associated  sensitivity 
function  equation 


a    /  SxftA  t      ax         T    3K 

Tt  l-55~J  =  (A"-K)  *Q  +  bb    Tq- 


with  the  boundary  condition 

,d(x(9)) 


(III-6) 


*Q 


=    0. 


(in-7) 


th 


For    an   n      -order    system,    Equation    III-5   contains    n   first- 

2 

order    differential    equations.      Equation    III-l    contains    n 

n • ( n  +  1 ) 
first-order    differential   equations   of  which   — ^"^^  are 

unique   since   Q,   K,    and  K   are   symmetric   matrices.      Equations 

ttx    o        j    TTT    a.  •      /n-  (n  +  l)V  ,      (n-  ( n  +  l)\ 

III-3   and    III-6   contain  I        *         M         and  n  I — 2"/       unique 

first-order    differential   equations,    respectively,      Table   I 
demonstrates    the   rapidity   with   which   the   computational    com- 
plexity   increases. 


Table    I.      The  numbec    of   differential    equations,    N, 
that   must    be  solved   for   a   system   of  order 
n    to   evaluate   the   state-trajectory 
sensitivity,    cJx/dQ 


N 


l 

k 

2 

20 

3 

63 

4 

154 

5 

320 

10 

11025 

19 


dx 
The    state-trajectory    sensitivity   matrix,   — ,    must    be 

oQ 

observed  over  the  entire  trajectory  to  obtain  a  relationship 
between  it,  the  state  trajectory  and  a  new  weighting  matrix. 
A  subjective  decision  in  the  selection  of  a  new  Q  is  required 
since  there  does  not  exist  a  direct  analytical  relationship 
between  the  design  objectives  for  a  finite  final-time  problem 
and  the  weighting  matrix  Q. 

C.   THE  DESIGN  MEASURE  m 
1 .   Definition 

The  approach  that  seemed  most  promising  required  the 
formulation  of  a  vector  design  measure, 

m  =  f (Q;x  ,t) .  (III-8) 

Typical  examples  of  the  elements  of  m  are  listed  below 

a.  Max| u(t)|      0  *  t  ^  t 

t 

b.  Percent  overshoot 

c.  Time  to  maximum  overshoot 

d.  Time  to  first  zero  crossing 

e.  Time  to  reach  and  remain  within  5  percent  of  the 
final  value 

t.    iwi 

(t)2dt 


0 

/tf  dx(  t)xs  dx(t)dt 

= ,  where  HP is  the  state- 

J  da  b    a  '  0    a 


0 

vT 


0 
trajectory   sensitivity    to    variation    in    system  parameters,    a_, 

and    s    is    a    symmetric   positive   definite   matrix. 
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The  elements  of  ra  are  further  restricted  to  be  defined 
so  that  they  will  be  positive.   (It  should  be  noted  that  an 
analytical  expression  for  the  partial  differential  of  the 
elements  of  m  with  respect  to  the  elements  of  Q  does  not 
generally  exist.) 

The  desired  vector  design  measure  was  defined  to  be 
m  ;  the  vector ,  f ,  has  the  elements  defined  by 


A  ■      * 

f  .  *■■   m  .-m  . 

3         [    3      3 


3    =    1,2, 


(III-9) 


where  L  is  a  positive  integer,   The  elements  of  f  are  to  be 
made  acceptable  by  adjusting  the  weighting  matrix  Q. 

2 .   Difference  Approximation  to  the  Sensitivity  Matrix  dm/dQ 

dm 
The  sensitivity  matrix,  t——  can  be  approximated  by 

oQ 

perturbing  the  weighting  matrix  elements  q. .  to  form  a  finite- 

-«--  •        «.  +  -  ,    om./oq...   The 

difference  approximation  to  the  partials ,   — l   n 

vector  differential  dm  is  given  by 


dm    T 
dm    =   —   dQ, 


om 


where   rrr  has    the    form 
oQ 


(111-10) 


dm 
o"Q 


dm 
dmn 


dm, 
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dm. 


dq22         dq 
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dm 

^Ti 


(in-ii) 


dm. 


nn 


dm. 


d  q  dq 


nn 


dm 


nn 
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w 


and  dm  and  dQ  are  both  column  vectors,  with  dimensions  (Lxl) 
and  (mxl)  respectively.  Equation  (111-10)  is  used  to  select 
a  ^dQ  that  will  reduce  as  many  of  the  elements  of  the  design- 
measure  difference  vector,  f_,  as  possible. 

3 .   Computational  Algorithm  for  Selecting  Q 

The  steps  of  the  basic  algorithm  for  finding  the  "best" 
eighting  matrix  are  outlined  in  Flow-Chart  1,  with  details 
given  by  the  following  list. 

a.  Transformation  of  the  system  into  the  phase- 
variable  form,  in  order  to  use  a  diagonal  weighting  matrix  Q. 

b.  Selection  of  an  initial  diagonal  weighting  matrix. 

c.  Formation  of  the  design  measure  m  by: 

(1)  Integrating  the  Riccati  equation 

(2)  Finding  the  worst-case  initial  conditions 
x(0)  from  K(0) . 

(3)  Integrating  the  state  equations  with  K(t) 
and  x(0) . 

(4)  Setting  m  =  f(Q;x  ,t,tf). 

d.  If   m    is    not    defined    or    is    unreasonable,    a    restart 
is    made    at    step   b;    m    is    not    defined    if    some   element    does    not 
exist.       For    example,     if    the    optimal    system    is    overdamped, 
percent    overshoot    has    no   meaning. 

e.  Formation    of    the    design-measure    sensitivity   matrix 


dm    , 
-=   by 

dQ 


(1)   Perturbing  the  Q  elements,  q .  .  , i  =  l ,  2  ,  .  .  .  , n . 
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(2)  Integrating  the  n  sets  off  — °-± M  Riccati 

equations ,  K  ,  with  Q   =  diagonal  ( q,  ,  , q„_ ,  .  .  .  , q .  . +dq ,q   ) 

v^lln22'     '^iiMn     ,nnn' 

for  i  =  1,2,. .  .  ,n. 

(3)  Integrating  the  n  state  equations  using  K  (t). 

(4)  Forming  the  perturbed  vector  performance 

i   •    i 
measures,  m  ,  l  =  l,....,n. 

dmj         m^-m. 

(5)  o7~   "c"^1  i  =  1>2'  ••••'"'  J  =  1,2 ,...., L. 

4ii     ii 

3m 

f .  Selection  of  a  normalized  dQ,  using  a  —■,    that 

—  oQ 

will  improve  as  many  of  the  elements  m.  as  possible.   This 
procedure  is  discussed  in  more  detail  in  section  III  C4« 

g.  Selection  of  the  magnitude,  OL ,  for  dQ  and 
evaluation  of  m   by: 

(1)  Initializing  OL 

(2)  Setting  q'=  Q  +  CjqdQ  where  I  is  the  nxn 
identity  matrix. 

(3)  Forming  the  vector  performance  measure  m 

t 
for  this  value  of  Q   by: 

(a)  Integrating  the  Riccati  equation's 
using  Q  . 

(b)  Finding  the  worst-case  initial  con- 
ditions x'(0)  for  k'(0). 

(c)  Integrating  the  state  equation's  with 
x'(0)  and  K'(t). 

(d)  Setting  m'  =  f ( Q* ; x ' , t , t  ) 
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h.   Formulation  of  subjective  decisions  based  on 

t±    =    iBi/Bi  |   i  =  1,2,..., L        (111-12) 
and 

li  t  |SL  "Ei  I   i  =  1>2'---.L      (in-13) 

(1)  f   is  considered  to  be  an  improvement  on  f 
if  any  of  the  following  conditions  exists: 

(a)  f ±  *  fi    i  =  1,2,... ,L 

(b)  The  number  of  values  of  i  for  which 
f  .  ^  f.  is  greater  than  L/o 

(2)  f_   is  considered  to  be  acceptable  at  this 
step  if  any  of  the  following  conditions  exist; 

(a)  f .  ^  e !  for  a  majority  of  the  elements 

v     '  l  l  J 

f.    where   6.     is    a   positive    small    number;     i    =    1,2,...,L. 

(b)  OL   ^    Gp;    where   Sp    is    a    small    pos  it  ive  number. 

V 

(3)  f      is    considered    to    be   acceptable   for    the 
design    if    any    of    the   following   conditions    exist; 

(a)  f.    ^»    t:  .'    for    a    majority    of    the    elements 

11 

of  f   where  S .  is  a  small  positive  number  (£ .  <  e . )  and  it  i: 

—  i  c  v  l     i  ' 

clear  that  no  further  significant  improvement  can  be  made  in 
the  other  elements  by  moving  locally. 

(b)  OL   ^  t   where  £   is  a  small  positive 

P         P 

number  and  the  inequality  6   «  £   holds. 

P  P 

(4)  (a)       If    h„     (1)     is    true,     increase  OL  and   go 
to    s  t  ep    g  .  (  2  )  . 

(b)  If    h.(l)    is    not    true,    decrease  OL   and 
go    to    s  tep    g . ( 2  )  . 

(c)  If    h.(2)     is    true,    go    to    step    e,    with 

•  Q  =   Q\ 

2k 


.s 


Flow-Chart    1.       Basic   Steps    of   One    Iteration    of    Design   Algorithm 


Select    Initial    Diagonal 
Weighting  Matrix    Q 


-*~® 


1 


Form    Design-Measure   m 


Form    Design-Measure 
Sensitivity   dm<£Q 


Select   A   Normalized    dQ   That 
Causes 

dm  T 

dm    =   r=      dQ 
—         dQ     — 

To   Reduce   The   Elements    Of 

f    =    | m-m 


Initialize     OL 


-<-© 


Form    Design    Measure   m 
From   Q*    =   Q+aidQ 


V 


Acceptable    Design    If 

1.    f!    ^    eV    For    At   Least    -    i ' s 


i  l 


2.   a  <  e 


or 


or 


3-    No    Significant    Improvement 
Can    Be   Made   Locally 


\/  Acceptable  NotwAccep table 


6 


© 
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Flow  Chart  1.   continued 


Test  for  Global  Improvement 
By  Selecting  New  Initial  Q 


6 


m      Acceptable    For    This 
Iteration    If 

1 .    a  ^   e  ' 


or 

2.    f'   £   e"    For    At   Least  ^   i's 
In  2 


Acceptable      Not  i'  Acceptable 


Q  =   Q 


S 


m      Is    An    Improvement    On 
m    If 

f.    ^    f .    For    At   Least   —    i's 
li  2 


Yes 


Increase 

a 


No 


Decrease 
CL 
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i.   Testing  the  weighting  matrix  found  by  perturbing 

t 

Q   to  determine  if  a  significant  reduction  can  be  made  on  the 

elements  of  f*.   If  a  significant  improvement  can  be  made  go 

to  step  e,  with  Q  =  Q  . 

4.   Considerations  for  Selecting  clQ 

a.   Problem  Formulation 

dm  . 
The  vectors,  —7^,  j  =  1,2,...,L,  are  normalized 

to  the  vectors  w .  by 
-J 


dm  . 


w  •  =  T7^ 

~3      <>Q 


(in-14) 


\ 


j  =  1,2,,.. L 


n 
i=l 


om.| 
dQ  J 


There    exist    L   hyperplanes    H.    defined   by 

H-j :  frULj  »dcA)  =  0  j    =   1,2,..  .  ,l  (111-15) 

where  (.  ,  .  )  denotes  the  inner  product  in  n-dimens ional 

Euclidian  space,  E  .   w  is  in  the  direction  of  the  largest 

rate  of  increase  of  dm..   Therefore  the  best  &Q  to  select 

for  a  particular  dm.  is  colinear  with  f w  .  .   The  s iqn 

"J  — 3 

I     *l 
selected  must  be  that  which  causes  dm.  to  minimize  f  .=  m.-m. 

— J  3    '  3      3] 

For  L  >    1,  a  systematic  procedure  must  be  established  to 

select  a  dQ  that  will  minimize  as  many  f .'s  as  possible. 
—  3 

The  unit  normals,  n.,  j  =  1,2,...,L,  that  result 

in  a  reduction  of  f .  are  qiven  by 

3 


n  . 
-3 


w 


-w 


m  .  ";  m 
3  3 


j    =  1 ,  2  ,  .  .  .  ,  L 


(III-I6) 
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Defining    y    =    BQ,     there    exist   L    half-spaces    S.,    where   S. 
-       —  3  3 

is    the   set    of    all  j/    that    satisfy    the    relation 

(-j'Z)  ~    °  j=l,2,...,L.  (111-17) 

Thus  the  hyperplane  H.  and  its  normal  n.  define  a  half-space 

3  ~3  F 

S.    which    is    the    set    of   all    points    that    reduce   f .. 

3  3 

The  intersection  of  all  the  S.'s,  given  by 
L 

s  =  n    s.,  (111-18) 

j=i   D 

defines    the    set    of   all    points    that    reduce   all    f .    simultaneously, 

provided    that    S    is    not    the    set,    cp  ,    which    contains    only    the 

origin.       If    S    =  <p  ,    some    of    f  .'s    must    be  allowed    to    increase 

so    that   a    partial    improvement    can    be   made   at    this    step.       This 

relaxation    should   be  made    only    for    one    iteration. 

b.       General   Problem   Considerations 

(1)       First-Order    System.      All    normals    n  . ,    for    a 

first-order    system,    must    be   of    equal    sign    to    improve   all 

components    locally.       If    this    is    not    the   case,    the   selection 

of    dQ  becomes    subjective    for    a   particular    trial   point. 

(2)       Second-Order    System.       A   second-order    system 

is  considered  next  with  L  <  2  .   Since  all  the  normals,  n., 

~3 

have  been  normalized  to  be  unit  vectors,  the  inner  products 

Rij  =  <f-i'-j^  ;  ij  J  =  1'2>°-'L;  i    *   1  (111-19) 
indicate  the  nature  of  the  sets,  S.  .,  given  by 

S.  .  =  S.As..  (111-20) 

1J        1      J  v  ' 

R..  =  1.0  implies  that  n.  and  n.  are  parallel,  therefore 

S.  .  =  S.  =  S ..  (111-21) 

as  indicated  in  Figure  1. 
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Figure   1.       Intersection    of   2   half-spaces    in 
2-space.    R . .    =    1 . 


R.  .    =   -    1.0    implies    that   n.    and   n.   are  anti-parallel;    there- 
ij  K  -l  -j 

fore 


S.  .    =  H.    =    H. 


(111-22) 


as  indicated  in  Figure  2. 


Figure  2.   Intersection  of  2  half-spaces  in 
2-space.  R .  .  =  -1 . 
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If   R.  .    f    +    1.0    then    there   exists   a    region,    R    ,    where   both 
ij        —  s 

inner    products   /n .  ,jA  and  /n  •  >x\     are   greater    than   zero,    as 
required    to   reduce    the   design-measure   difference   elements 
f.    and   f  .    simultaneously.      This    is    depicted    in    Figure    3« 


0j\ 

>*  i 

H^l 

^*i 

A 

Figure   3.       Intersection    of   2   half-spaces.    R. .    ^  +   1 


Suppose   that  L   =   3  for    a    second-order    system, 
If    R    .    /    +    1    then    in      and  _n      are    linearly    independent    and  ri 
can   be   expressed  as    a    linear    combination   of    n      and   n      by    the 
relationship 


n„    =    Na 

~5  ~~ 

where  N  is  the  partitioned  matrix  given  by 


N    = 


Hi !  n? 

—1  i    — z 


(111-23) 


(111-24) 


and  a    is   a   column    vector   with   components    a    ,    a    . 

For    example,    Figures    4   thru    11   depict    the 
relationships    that   can    exist    between   half-spaces    S, ,S„    and   S_ 


30 


for  various  combinations  of  a   and  a  .  In  Figure  4,  S 

contains  the  intersection  of  Sn  and  S0 ;  therefore  S„  may  be 

1       ^  j 

dropped  from  consideration. 


Figure  4-   Intersection  relationships  for  a  >0 ,  a  >0 . 

The  same  situation  holds  in  Figures  5  and  6,  where  S   and  S_ , 
respectively,  may  be  dropped  from  consideration. 


Figure  5-   Intersection  relationships  for  a  >0 ,  a  <0 
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Figure  6.   Intersection  relationships  for  a  <0 ,  a  • 


>0 


In   Figure   7,    S_    =   S,    and    in   Figure   8,    S_    =   S„;    therefore   S_ 
may   be   dropped  from   consideration    in   both   cases. 


Figure   7.       Intersection    relationships    for    a    =1,    a    =0 

J.  ^ 


fluffs 


Figure   8 


Intersection    relationships    for   a    =0 ,    a    =1 
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!n    Figures    9,    10   and   11,    S   0s2<lS      =   0;    therefore  a 


t    least 


one    S.    must    be   dropped  from  consideration    to   have   a   non-zero 

dg. 


H,,  Hs 


Figure  9-   Intersection  relationships  for  a  =-1 .  ,  a2-<9. 


Figure  10.   Intersection  relationships  for  a  =0 . , 
a2=-l. 
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Figure  11.   Intersection  relationships  for  a  <0,  a  <0 


Slns2ns3  =  o. 

The  general  results  related  to  these  figures  are  tabulated  in 
Table  II. 


igure 

al 

a2 

Relationship 

k 

>o 

>0 

s  ^  s  n  S 

j             X              £* 

5 

>0 

<0 

Sl2_S2AS3 

6 

<0 

>0 

s2=.Slrts3 

7 

>0 

=0 

s3  =sx 

8 

=0 

>0 

S2   =s3 

9 

<0 

=0 

Sin  S3=Hl=H3 

10 

=0 

<0 

slAS2OS3=t 

11 

<0 

<0 

s ,  n  s^n  s  =  c 

Dr  op  Fr  om 
Consideration 


or    S. 


Sl   °r    S2    °r    S3 


Table    II.      General    relationships    for    sets    S., 

3 
j    =    1,2,3  for    a    second-order    system 

when  /n    ,nA    /   +    1. 
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As  an  example,  if  Table  II  has  indicated 
that  S  should  be  dropped  from  consideration,  the  normals 
j2  ,J2  may  be  used  to  form  a  vector,  dQ  ,  that  lies  in  the 
region  R  given  by  the  angle  Oi  in  Figures  12  and  13-  dQ 
is  defined  by 


dQ   = 


Si ;  £2]  £ 


(111-25) 


where  _c  is  a  column  vector  with  components  c  ,c  .   If  c   and 
c      are  restricted  to  be  positive,  then  _dQ   lies  in  the  region 
R   which  is  contained  by  R   if  /n  ,n  \  ^  0,  as  in  Figure  12. 
R'  contains  R   if  /n  ,n A  <  0,  as  in  Figure  13.   For  _dQ '  to 
lie  within  the  region  R  ,  the  angles  0  ,  and  0   must  both  be 


less  than  or  equal  to  90  degrees.   Let 

dQ' 
dQ  = 


^(dQ^^dQ^)2 


(111-26) 


Then    the   restrictions    on   0      and  9      become 


(Hl'-S) 


o\ 


and 


<£25dQ) 


^    0 


(111-27) 


J 


Figure  12.   Region  relationships  for  /n  >n.?\  a  0 
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Figure  13-   Region  relationships  for  /n  ,n\  <   0. 


The  procedure  discussed  above  considers  only 

three  normals,  n  . ,    j    -   1,2,3,    at  a  time,  but  can  be  extended 

to  the  case  where  L  >    3  in  an  iterative  fashion.   At  each 

iteration,  one  n  .  is  dropped  from  consideration  using  Table  (II) 

This  process  is  continued  until  all  n.'s  have  been  considered. 

-J 

(3)      Third-Order    Systems.      For    a    third-order    system, 
similar    reasoning    is   used   to   develop   a   basis    of   three   linearly 
independent  _n.'s.      A   fourth   normal    n,    can   be   represented   by 


^   =   aiHl    +   a2^2    +   a3% 


=    Na 


(111-28) 

(111-29) 
(111-30) 
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3 
If  all  a.  s  0,  then  SS»  D    S  .  and  S,  can  be  dropped  from 

consideration.   If  all  a.  <  0,  f\     S  .  =  cp  and  one  of  the 


four  S.'s  must  be  dropped  from  consideration.   Table  III 
gives  the  appropriate  relationships  for  n  =  3>  L  =  45  where 
any  3  of  the  normals  n.    are  linearly  independent. 


a     a     a     Relationship  Drop  From  Consideration 

*■     £  j 

so      so      so      s=>  s^s.ns,  s, 

TT     1        2        3  4 

<0        <0         <0  7\     S  .    =  cp  S,     or    S„    or    S_    or    S, 

j=l  -3  1234 

=0     >o     <o     s„3s,  ns0ns,  S„ 

2 1         3         -4  2 

4 

=0        <0        <0  n     S  .    =   cp  S„    or    S.    or    S, 

j=l    D  2  3  4 

>o      <o      <o      sn3Sons  _ns,  s, 

1 2         3         if  1 

>o      >o      <o      s,n  son  s0  is 

-L  «*-  3 

intersected   by    S, 
in    such    a    way    as 
to    form   a    fourth 
bounding    hyperplane. 


Table    III.      General    relationships    for    sets    S., 
j    =    1, . . ,4    for    a    third-order    system 
when    n    ,n      and    n      are    linearly 
independent . 


The   relationships    that    exist    for    a      >    0, 

a      >   0    and    a      <    0    in    Table    III    imply    that    many    boundary 
^  3 

hyperplanes    could    exist    for    systems    of    order    higher    than 
two  when    the    number    of    hyperplanes,    L,     is    greater    than    the 
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order  of  the  system  under  consideration.   Results  from  linear 
algebra  LlOj  can  be  used  to  show  that  there  may  be  L-(n+l) 
bounding  hyperplanes  and  therefore  L-(n+l)  normals  to  con- 
sider.  For  this  reason,  the  algebraic  development  was  not 
pursued  further  for  cases  where  L  ^  n+1. 

The  set  of  hyperplanes  not  excluded  from 
consideration  form  a  convex  polyhedral  cone  in  n-dimens ional 
Euclidean  space.   Unit  vectors,  u .  ,    defined  as  being  colinear 
with  the  extreme  edges  of  this  cone,  when  summed  with  positive 
weighting,  form  an  interior  vector  of  the  cone.   These  unit 
vectors,  u.,  can  be  found  using  linear  programming  techni- 
ques [ll  J  . 

The  problem  may  be  reformulated  into  the 

Simplex  format  as  follows.   The  linear  function 

n 
Z  =  E    y  (111-31) 

1  =  1    ! 

is  to  be  maximized  subject  to  the  constraints 

(E-j->£\2  °      5    =  1,2,...,L  (111-32) 

yj  <  •       i  =  1,2,. .  .  ,n  (in-33) 

n 

Z      y.  *  B  (111-34) 

1=1  x 

where  B  is  a  positive  number.   If  Z  can  be  maximized  by  the 
Simplex  routine,  Z  will  be  equal  to  B,  and  there  may  be  more 
than  one  solution,  y_.         If  there  is  no  solution,  one  of  the  con- 
straints in  equation  (111-32)  must  be  relaxed.  If  there  are  multiple 
solutions,  each  solution,  y_  . ,  forms  a  vector  which  is  colinear 
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w 


ith  an  extreme  edge  of  the  polyhedral  cone  formed  by  the  set 


s  =  n  s . 

3  =  1    D 


(in-35) 


(See  Figure  14. ) 


Figure  14.   Intersection  o±  3  hyperplanes  in  3-space 

The  Simplex  approach  requires  from  one  to 
L  -  n  applications  of  the  Simplex  routine.   It  was  felt  that 
the  computation  required  was  too  complex  and  time-consuming 
to  allow  the  overall  algorithm  to  be  a  feasible  design  tool. 

If  L  is  restricted  to  be  less  than  or  equal 
to  n  +  1 ,  the  algebraic  procedures  considered  previously  may 
be  applied  to  find  the  normals  of  the  boundary  hyperplanes. 
For  ease  of  computation  and  to  make  the  algorithm  feasible, 
L  was  further  restricted  to  be  less  than  four. 
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Problem  Considerations  for  L  ^  n  +  1 
If  the  partitioned  matrix 

N  =  [n^n*,,...,^] 


(III-36) 


is  considered,  the  rank  of  N,  r(N),  gives  the  number  of 
independent  normals.   If  r(N)  =  L  then  all  normals  are 
independent.   The  vector  _dQr  given  by 


dQ   =  Nc 


(IH-37) 


will  be  interior  to  the  set 


L 

s  =  n  s. 


(III-38) 


if    the   elements    of    c_  are  non-negative.       If   r(N)    <    L  then    the 

L-r(N)    half-spaces    S.,    associated   with    the    linearly  dependent 

normals    removed    from   N    (for    this    step    only)    to    give  the    re- 
duced  matrix    N    .       Then    dQ       is    given    by 


dQ*    =   N*c 


(111-39) 


where  c  is  now  an  (r(N)xl)  row  vector  with  positive  equal 
elements . 

Table  II  gives  the  general  relationships  that 
exist  for  an  n   -order  system  when  L  =  3  and  r(N)  =  2. 

A.   ■L 

Similar  relationships  are  given  in  Table  IV  for  an  n   -order 

system  with  L  =  3  and  r(N)  =  1.   Table  V  gives  the  relationships 

th 
that  exist  for  an  n   -order  system  with  L  =  2  and  r(N)  =  1. 


kO 


Table    IV.       General    relationships    for    sets    S.,    S. 
and    S,     where   n    =    2,    L    =    3   and    r(N)    =    1 


ilk 


a,  n  .  •    n  .    =    an  . 
l-i      -3  2-i 


1 

2 

>0 

>0 

>0 

<0 

<0 

>0 

<0 

<0 

Relationship 


S.    =   S  .    =    S. 

l  j  k 

s.^s.ns,    =h.    ., 

i         j         k  i,j,k 

S.^S.^S,     =H.     ., 
i         j         k  i,j  ,k 


s.ns.As,    =  h .    .  . 

13k  1,3 ,k 


Drop    From  Consideration 

none 

S  .,     or    S .    and   S. 


S,  ,    or    S .    and   S  . 
k  1  3 


S.  ,    or    S  .    and   S, 
1  3  k 


Table   V.       General    relationships    for    sets    S.    and    S. 

1  J 

where    n   ^    2,    L    =    2,    r(N)     =   1.       n.    =    an. 


a 
<0 


Relationship 


S.  =  S. 

1     J 


Drop  From  Consideration 
none 


S.Hs.  =H.  or  H.    S.  or  S  . 
1    J  1      J     1      J 


The   vector   _dQ      found    by    Equations    111-37    or 
III-39,    when    normalized    to    unit    length    gives    the    dQ   required 
in    step    f .    of    the    algorithm   for    selecting    a    new   weighting 
matrix   Q. 
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IV .       EXAMPLES 


A.       A    SECOND-ORDER    EXAMPLE 

The  second-order    system   selected   for    consideration    is 
given    in  phase-variable   form   by 


*(t)    = 


0.0  1.0 

-20.     -5.0 


x(t) 


u(t) 


(IV-1) 


The  final  time,  t  ,  was  arbitrarily  set  at  2.5  seconds.   The 
design  measure,  m,  selected  for  examination,  had  the  following 
elements : 

i   -  percent  overshoot  for  x  (t) 


m. 


m   -  time  to  maximum  overshoot  for  x  (t) 
m   -  max  | u( t) | ,  0  ^  t  £  t 


which  had  the  desired  values 


-* 

5.0 

1 

% 

m      = 

0.925 

seconds 

0.0 

Percent  overshoot  is  defined  by 


mi    = 


overshoot    of   x    (t) 


x1(0) 


xlOO 


(IV-2) 


(IV-3) 


1 .       Estimation   Procedure 

The   first    method   used    to    select    a    suitable   weighting 
matrix    Q  was    to   guess    an    initial    Q,    solve   for    the    design 
measure   m   and    then    make   a    new    estimate    for    Q   based   on    m.       This, 
of    necessity,    was    accomplished   on-line   with    the    IBM    36O-67 
computer    in   a    time-sharing    mode. 
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The    estimation   procedure   used    is    given    in    the 
following    steps. 

a .  Guess  ing    Q 

b.  Evaluating  m 

c.  Repeating  steps  a.  and  b.  until  one  element  of 

* 
m,  m.,  was  close  to  m.. 
-J  J 

i+l  * 

d.  Selecting  Q     so  that  m.  remained  close  to  m. 

D  3 

and  improvement  was  made  on  one  of  the  other  elements  of  m. 
This  was  accomplished  by 

(1)  Perturbing  Q 

(2)  Evaluating  m 

(3)  Repeating  steps  (1)  and  (2)  until  a  direction 

of  change  was  established  that  improved  one  of  the  other 

# 
elements  of  m  while  keeping  m.  close  to  m.. 

—  r  —l  i 

(4)  Changing    Q      as    far    as    possible    in    the 
direction    determined  above. 

e.  Step    d.    was    repeated  until    all    of    the    elements    of 
m   were   as    close   as   possible    to   their    associated   elements    in 

m    .       This   procedure   changes    Q  along    a    contour    of   m.     in    the 

qll^22   plane' 

Using  this  procedure  led  to  the  weighting  matrix 

Q  =  diag  [85.6,  I3.6I,  with  a  computation  time  estimated  at 

25  minutes. 

2 .      Exhaustive   Search 

The    exhaustive   search    for    the    second-order    example 

was    arbitrarily    restricted    to    the    region    R    defined    by 

(°   S    qll    *    10°' 
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R  was  divided  into  grid  points  with  intervals  of  dq   =2.0 


and  dq   =0.25;  dq?;?  was  required  to  be  this  small  by  th 


e 


low  sensitivity  of  m   and  m   with  respect  to  q   .   This 

X  <c  XX 

low   sensitivity    can    be    seen    in    Figures    15   and    16 .       Approxi- 
mately   100    minutes    of    IBM    360-70    computation    time   was    re- 
quired   to    complete    the    evaluation    of   m   at   all    grid  points. 
Figures    15,    1°   and    17,    obtained   from   this    search, 

give    contours    for    selected   values    of    m    ,    m      and  m    .       Figure    1^ 

1        ^  3 

is    a    composite   of    these    figures.       Graphical    construction 
indicates    that    the    desired   weighting   matrices    is    in    a    neigh- 
borhood   of    Q   =    diag    [8l.0,    12. 8J  . 

3 .      Application    of    Design    Algorithm    to    Select    Q 

The   algorithm   given    in    Chapter    III    was    applied   with 
all    three    elements    of   m   being    considered   in    the   selection 
procedure   for    _dQ,    for    three    initial    Q   s.      Two    initial    Q   s 
were    selected    to    test    the   algorithm   with    only    m      and   m      being 
considered    in    the    selection   procedure    for    dQ.       The   results    of 
these,  trials    are    given    in   Table  VI. 

Attempts    were   made    to    test    the   algorithm   with    only 

m      and   m      or    m      and   m      being    considered    in    the    selection 
12  2  3 

procedure    for    dQ.       The   moves    made   by    the    algorithm    did   not 
tend   to    improve    the    element    not    being    considered,    or    approach 
a   best    Q    for    all    three   elements    of    m.      This    is    partially    due 
to    the    insens it ivity    of    m    ,    with   respect    to   Q.       This    insensi- 
tivity   was    exaggerated   by    the   non-continuous    nature    of    time 
in    the    digital    computer    calculations. 


44 


o 

r-    O 


O 
CTi 


o 

CM 


r 

00 


VO 


CO 


CM 


co 


U> 


<*>  I     o 
en 


>=r 


o\° 


o 

00 

1 

-P 

I 

3 

0) 

o 

r- 

S    •- 

M-l        X 

W      IW 

a  ° 

0     +» 

o 

il 

O       UJ 

ft 

O 

Q    *• 

IT) 

•5   § 

o 

gj     M 

§     1 

.H 

0<      M-l 

0 

O 

CN 

rr 

rH        CN    ID 

cT  ?  1 

H  H 

.H    flj 

a    > 

o 

. 

ro 

m 

h 

(D 

i 

& 

-H 

Cn 

o 

CM 

J  ° 


CN 


<N 
CM 

a 


45 


rH 

a 


O 


a)  w 

3  i 

a*  o 

CN  £ 

?  I 

rH  ffj 

a  g 


rH 


•H 

Cm 


CN 

a 


46 


a 


r-t        -P 
CN 


? 


a    o 


03 


-H 
Cm 


CM 
CM 


a 


47 


a 


00 


CN 
(N 

a 


48 


Figures  19,  20  and  21  show  the  initial  iteration 
moves  made  by  the  algorithm  for  trials  1,  2  and  4  in  the 
q   -q    plane.   For  the  initial  points  tested,  the  largest 
number  of  iterations  required  to  move  Q   (the  superscript 
i  refers  to  the  latest  iteration  number)  to  close  proximity 
to  the  best  Q  was  eight.   (No  claim  as  to  the  uniqueness  of 

a  best  Q  is  made  for  this  algorithm  as  this  depends  on  the 

...     0 
system,  initial  Q  ,  and  design  measure  being  considered.) 

From  the  point,  Q  ,  which  is  in  close  proximity  to  the  best 
Q,  at  least  20  and  not  more  than  30  iterations  were  necessary 
to  arrive  at  a  locally  unimprovable  weighting  matrix,  denoted 
by  Q  .   The  Q  's  thus  found  were  not  equal,  although  all  de- 
sign measure  elements  were  considered  to  be  satisfactory. 
The  largest  variation  being  in  q   ,  to  which  all  elements  of 
m  are  relatively  insensitive  in  this  region. 


Table  VI.   Results  for  Second-Order  Example 


L 

m  .  's 

Consider  ed 
to  select 
dQ 

Initia 
Q 

1,1 

1 

2,2 

Final 
Q 

1,1 

2,2 

3 

m  ,m  ,m 

10.0 

1.0 

81.37 

12.897 

3 

mi 'm2 ,m3 

1.0 

10. C 

83.46 

12.864 

3 

m  ,m2 ,m 

100.0 

1.0 

80.44 

12.683 

2 

m,  j  IB  o 

10.0 

1  .0 

79.81 

12.916 

2 

mX  'm^ 

100.0 

1  .0 

8l.4l 

12.914 

Final 

m 

12  3 

5.0057    0.925  2.075 

5.016      0.925  2.062 

5.08         0.925  2.044 

5.0001    0.925  2.076 

4-9999    0.925  2.0226 
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B.       A   THIRD-ORDER    EXAMPLE 

The    third-order    system   considered  was    taken    from   L4J. 
It    is    for    the    linearized    incremental    longitudiual    motion    of 
an   aircraft..      The    system    is    given    by 


x(t)    = 


-0.0016         1.0  -.0002 

-0.1569       -0.0015       -.1131 

0.0  0.0  -.666 


*(t) 


0.0 
0.0 

0.666 


u(t) 


(iv-5) 


The    final-time,     t    ,    was    arbitrarily    set    at    2.5    seconds.       The 
design    measure,    m,    selected   for    examination,    had    the   following 
elements : 


-  percent    overshoot   for    x    (t) 

-  time    to   maximum   overs] 

-  max  I u( t) I ,  0  £  t  £  t 


m   -  time  to  maximum  overshoot  for  x  (t) 

m 


which  were  assigned  the  desired  value 


m 


4-5    % 
0.91   sec 
0.0 


(IV-6) 


The  system   was    transformed   to    the  phase- var iable   form    in 
the    manner    of    [ 5  J ■       The    transformation    matrix 


-41.329 
-    3.41561 
52.809 


-0.08026 
-41.329 
1.406 


0.0 

1.536    x    10 

6.71141 


-7 


(iv-7) 


results    in    a    system   matrix    given    by 

r 


A, 


0. 
0. 

-53- 


0. 

1. 

-6.8 


(IV-8) 
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Therefore  the  system  is  given  by 


i(t)  =  An£(t) 


o- 


u(t) 


(IV-9) 


The  design  measure,  m,  is  defined  with  respect  to  the 
original  states.   Since  it  was  desired  to  observe  the  state 
trajectories  for  both  the  phase- var iable  form  and  for  the 
original  states,  the  computer  program  was  written  to  trans- 
form the  phase  state  z,(t)    to  x(t)  at  each  integration  step, 
in  order  to  evaluate  m.   A  more  direct  method  is  to  trans- 
form the  diagonal  weighting  matrix  to  the  general  form,  Q 
and  perform  all  integration  in  the  original  state  form. 


Q   is  given  by 


-1  T    -1 
Q   =  (T   )iQ(T   ) 
y 


(IV-10) 


Kriendler  's    L  4]    selection    for    the    original    system 
weighting   matrix    is    Q      =    diag   [lO.O,    0.5,    O.O].       This    Q 
led    to    the    design    measure 


m 


4.497 
l.i 
97.2 


(IV-11) 


No   attempt    was    made    to    guess    the    best    Q,    or    to   use    the 
exhaustive   search   method,    as    it  was    felt    the    expected   results 
would   not    have    been   worth    the    time    or    effort    involved. 

The   algorithm   given    in    Chapter    III    was    applied    to    the 
third-order    example,    with    one,     two   and    three    design-measure 
elements,    m.,    being    considered    in    the    selection   procedure   for 
dQ.       The   results    of    this    application,    with    test   points,    are 
tabulated   for    all    trials    in   Table   VII. 
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Favorable  results  on  any  one  trial  depended  on  the  initial 

weighting  matrix,  Q  ,  selected  and  on  the  elements  m.,  being 

considered.   The  first  trials  (1-8  in  Table  VII)  were  made 

considering  either  all  three  elements,  m.,  or  elements  mn 

J  1 

f  * 

and  m  .   Most  initial  points  resulted  in  an  m   close  to  m  , 

f  *   f 

but  m   could  not  be  reduced  to  m  •  m   was  at  an  apparent 

local  minimum  in  Q  space.   Those  trials  that  considered  all 

design  measure  elements  in  the  selection  of  dQ  tended  to 

reduce  m   more  rapidly  in  the  local  region. 

Since  m   seemed  to  be  least  changeable  for  these  first 

0  .    f 

trials,  a  starting  Q  was  selected  that  had  resulted  in  m 

close  to  m  .   A  trial  (9)  was  then  made  considering  only  m 

for  selecting  dQ.   The  result  was  a  significant  reduction  in 


m  -m  I   while 


m  -m 


did  not  increase  unreasonably.   Sub- 


sequent trials  alternated  between  considering  m?  and  con- 
sidering both  m   and  m   in  the  selection  procedure  for  dQ, 


with  a  resulting  Q   that  reduced  both 


m    -m 


and 


m2"m2 


to   an    acceptable    level.       The    Q      thus    found  was    used  as    the 

initial    Q      in    a    trial    (14)    where   all    three    elements    m.,    were 

J 

considered  in  the  selection  procedure  for  dQ.   This  trial  ( 14 ) 


significantly  reduced  both 


m    -m 


and 


m2"m2 


in    two 


iterations.       Tests    in    the    neighborhood    of    the    Q      found    in 

trial    ( 14 )    showed   that    the    element,     q00?    was    zero   for    this 

33 

s  y  s  t  em . 
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TABLE    VII        .     RESULTS    OF    TFST 
ORDER    EXAMPLE 
TRIAL    ACTIVE  OMNITIAL 

NC.  CONSTRAINTS    F:EINAL 

ELEMENTS  T:TEST 


1         1,2 


2         1,2 


3         1,2,3 


4         1  ,2 


1,2,3 


1,2 


~r        1,2,3 


0 
F 

0 

E 
0 
F 
0 
F 
T 
0 
F 
0 
F 
0 
F 
0 
F 
F 
F 
0 
F 
0 


NG 

ALGORITHM  ON 

A  THIRD- 

I 

0(  I  ,n 

M(I  ) 

I 

17000.000 

4.6 

850.00 

1.1 

3 

1.0F-9 

95.8 

1 

1720C.O0 

4.  56 

■y 

855.80 

1.1 

?, 

1.0E-9 

96.17 

i 

1232.0 

5.55 

2 

649.0 

1.48 

3 

1.0E-9 

32.46 

1 

11526.0 

4.50 

? 

812.5 

1.175 

3 

1.0F-9 

73.89 

1 

115  30.0 

4.5 

? 

812.5 

1.175 

^ 

1.0E-9 

73.89 

1 

11524.2 

4.511 

2 

811.2 

1.175 

3 

1.0E-9 

73.884 

1 

17090.0 

.4.558.4 

2 

855,0 

1.1 

3 

1.0E-9 

95.  776 

1 

17439.83 

4-. 4969 

2 

866, 68^3 

1.1 

1.0E-9 

97.231 

1 

17490*0 

4.4968 

2 

866.  7 

1.1 

3 

l.OE-9 

97.231 

1 

17489.3 

4.A97 

? 

866.68 

1.  1 

3 

1.0F-9 

97.231 

1 

17490.21 

4. 5021 

9 

855.9717 

1.1 

3 

1.0.E-9 

97.231 

1 

10000,0 

16.717 

2 

1.0 

1.05 

-> 

0.0001 

65.6 

1 

10034.00 

9.  53 

2 

586.23 

1.0125 

3 

-  28. 93 

65.45 

1 

10031.27 

6.  78 

i 

t 

585.9265 

1.15 

3 

0.01 

66.95 

1 

10049.01 

4.5028 

2 

736.7891 

1.225 

3 

4.6321 

67.561 

1 

10049.01 

6.78 

2 

736.789] 

1.225 

3 

4.6  321 

67.561 

1 

10049.07 

4.4.91 

2 

786.2485 

1.225 

3 

5.4707 

67.596 

1 

A. 

10049.07 

4.6164 

■5 

C 

736.2485 

1.2 

-1 

0.01 

67.353 

i 

10057.14 

4.5021 

2 

802.4175 

1.2 

3 

-1.65517 

67.338 

1 

10057,14 

4.5021 

-■> 

802.4175 

1.2 

3 

-1.65517 

67.33* 

1 

10057. 13 

4.4764 

2 

802.783 

1.2 

3 

-0.7?456 

67.382 

1 

10  500.00 

4.5053 

2 

802.00 

1.1875 

3 

1.0E-8 

69.40 

56 


TABLF    VII        .    CONTINUFD 


TRIAL    ACTIVE 
NCi. 


OrlNITIAL        I 


0(1,1) 


M(  I  ) 


1C 


12 


13         2 


CONSTRAINT 

F  :FINAL 

FLEMFNTS 

T:TFST 

F 

1 

10523.85 

4.1638 

2 

83  .5637 

1.2 

3 

1.0E-8 

69.56 

1,2 

0 

1 

20000. 00 

3. 7668 

2 

1000.00 

1.0875 

7 

1.0F-7 

106.12 

F 

1 

20007. 16 

4. 5082 

2 

8  36.54 

1.075 

7 

l.OF-7 

106. CO 

2 

0 

I 

20000.00 

4.5115 

2 

836.0 

0.9 

3 

1.0E-7 

105.98 

F 

1 

46490.00 

5.4 

? 

836.0 

0.9 

3 

l.OF-7 

178.14 

1,2 

0, 

1 

46^90. 0 

5.^ 

2 

836.0 

0.9 

3 

1.0E-P 

178. 14 

F 

1 

46493.05 

4,4895 

2 

1089.55 

0.925 

? 

1.0F-8 

178.33 

2 

0 

i 

46^03.05 

4.4395 

;> 

1039.  5ci 

0.92^ 

3 

1.0E-7 

1^8.3  3 

F 

1 

^7493.05 

5.29C6 

2 

Ql^.547 

O.O 

3 

1.0F-7 

180.45 

1,2 

n 

1 

474^3.05 

5.20C6 

2 

914.547 

0.9 

7 

1.0F-7 

180.45 

F,n 

i 

47242.65 

4. 5338 

? 

1033.722 

0.9125 

3 

1.0E-7 

180.03 

F 

1 

46246. 18 

4. 5065 

2 

1033.933 

0.O25 

3 

1.0E-7 

177.76 

2 

0 

1 

46246. 18 

4.50  65 

2 

1033.933 

0.Q25 

3 

1.0E-7 

177.76 

F 

1 

50000.00 

^.6105 

2 

1033. 033 

0.9125 

3 

1.0F-7 

136. 19 

0 

1 

^ocoo.oo 

4.61C3 

2 

1083. 033 

0.9125 

3 

0.01 

186. 19 

F 

1 

51000.00 

4.6371 

o 

1033.933 

0.9 

3 

0.01 

138.3  3 

1,2,? 

0 

1 

51000.00 

4.6371 

7 

1083.  933 

0.9 

3 

0.01 

138.33 

F 

1 

51001. OC 

4.50C5 

? 

11 16.933 

0.912  5 

3 

0.01 

188.42 

T,0 

1 

51001. OC 

^.5007 

2 

1116.933 
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The  best  Q  found,  using  the  algorithm,  transforms  to  the 


original  system  form,  Q  ,  given  by 


Q  = 

g 


29.87207 
-0.112076 


.-6 


-O.112076 
6.54338 


-1.39  x  10 
2.705  x  10 


-6 


-1.393  x  10     2.705  x  10  ;   6.497  x  10 


-14 


(IV-12) 


which    is   positive    definite. 

C.       DEMONSTRATION   EXAMPLE 

A   second-order    example,    that   had  not   been    considered 
previously,    was    selected   for    a    comparison   of    the   tr ial-and- 
error    estimation   procedure   and    the    design   algorithm.      This 
system    is    given    by 


x(t)  = 


0.0       1.0 

-1.0      -1.0 


£(t)    + 


0.0 
1.0 


u(t) 


(IV-13) 


The  final-time  was    arbitrarily    set    at   2.5    seconds.      The   design 
measure,    m,    considered   had   the  following    elements: 
m      -    percent    overshoot   for    x    (t) 
m      -    time    to   maximum    overshoot    for    x    (t) 


m      -    max    | u( t ) 
3  t 


which  had  the  desired  value 


0  £    t  £    t 


m 


5.0  % 

0.925      sec 
0.0 


(IV-14) 


The    estimation   procedure   was    applied   for    several    starting 
points,    with   no    success    in    satisfying    both   m      and   m    . 
Q   =    diag    [500.0,    0.0]    was    the   most    satisfactory   point    found; 
the    design    measure    for    this    Q  was    m      =    [4.629,     .925,    21.97]. 
CPU    time   was    seven    minutes. 
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The  design  algorithm  was  applied  for  an  initial 
Q  =  diag  LlOO.O,  O.lJ,  with  only  m   and  m   being  considered 
in  the  selection  of  dQ.   After  five  iterations,  an  unimprovable 
weighting  matrix,  Q  =  diag  LlOO.56,  0.11539J,  was  obtained, 
which  had  the  design  measure,  m   =  L5-026,  1.4,  9 . 59 J  •   With 
only  m   and  m   being  considered  in  the  selection  of  dQ,  an 
initial  Q  =  diag  [ 500 . ,  O.l]  resulted  in  Q  =  diag  [ 499. 9998, 
-I.I25]  and  m   =  [5. 0022,  0.925,  21.966'j  in  one  iteration. 
Considering  all  three  elements  of  m  in  the  selection  of  dQ, 
an  initial  Q  =  diag  [ 500 . ,  -1.125]  resulted  in  Q  =  diag  L499-5, 
-I.II969]  and  mT  =  [5.OOO8,  0.925,  21.9551  in  six  iterations. 
Five  minutes  of  CPU  time  were  required  to  perform  these  cal- 
culat  ions . 

Application  of  the  algorithm,  considering  one,  two  or. 
three  elements  of  m  in  the  selection  of  dQ,  for  the  initial 
point  Q  =  diag  [ 1000 .  ,  O.lJ,  failed  to  result  in  a  satisfactory 
design  measure.   All  moves  stayed  in  close  proximity  to  the 
initial  point.   This  failure  was  apparently  due  to  the  relative 
insens it iv ity  of  the  time  to  overshoot  with  respect  to  Q, 
which  was  exaggerated  by  the  discrete  time  intervals  used  in 
the  calculations.   Fourteen  iterations  were  performed  in  4.6 
minutes  CPU  time. 
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V.       SUMMARY    AND  CONCLUSION 

Since    the   optimal    state   trajectory    for    a    linear    regulator 
system   depends    upon    the  weighting   matrices    chosen,    it    is    de- 
sirable   to    establish   a    relationship    between    the   weighting 
matrix,    Q,    and    the    design    objectives. 

Many   authors    have   considered   methods    for    selecting   a 
weighting    matrix   for    the    infinite-final-time    (t      =  °° )    problem 
that    result    in    a    s.ystem    that   meets    their    requirements.       The 
only   methods    surveyed    that   can    be   applied   to    the   finite- 
final-time   problem    (t      <   » )    are    exhaustive    search    in    Q   space 
and   tr ial-and-error    adjustment    of    the   Q  matrix. 

The    exhaustive-search    method   appears    to   be   a    feasible 
method   for    selecing    Q  under    very    restrictive   conditions.       The 
region    that    is    investigated   must   be    small    or    computation    time 
borders    on    the    ridiculous.       This    method    is    only    feasible   for 
systems    where   only    two    elements    of    the   weighting   matrix,    Q, 
are   allowed   to   vary. 

The   estimation   procedure    does    not    require   as    many    calcu- 
lations  as    the   exhaustive  method    does    for    the    same   system, 
provided    the    subjective    decisions    are  made   properly   and   with 
efficient    use    of    the    computer.       The  procedure    could   be   applied 
in    situations    where   more   than    two    elements    of    the   weighting 
matrix   are   allowed    to    vary,    but    the    information    that    must    be 
processed  by    the   designer    becomes    excessive. 
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It  has  been  shown  that  the  sensitivity  of  the  optimal 
state  trajectory  with  respect  to  the  weighting  matrix  can  be 
evaluated  using  the  influence  function  approach.   Because 
this  evaluation  is  computationally  complex,  and  it  is  necessary 
to  consider  the  time-varying  trajectory  sensitivity  to  select 
a  change  for  the  time- invar iant  weighting  matrix,  it  was 
decided  that  this  approach  would  not  be  fruitful. 

The  procedure  selected  for  development  required  the 
formulation  of  a  vector  design  measure,  m.   This  design 
measure  was  composed  of  generally  used  time-domain  system 
characteristics  such  as  percent  overshoot,  time  to  maximum 
overshoot,  etc.,  and  desired  values  were  selected  for  each 
element  of  m.   The  purpose  in  selecting  Q,  therefore  became 

the  minimization  of  the  absolute  difference  between  each 

* 
element  of  m  and  its  desired  value  m..   This  difference  is 
-  J 


denoted   by 


f      =    |m.-m    | ;    j    =    1,2,...,L.  (V-l) 


dm 

The    sensitivity   of    the    design    measure,    denoted   by   ^— , 

OQ 
$m 
must   be  approximated   by   finite-differences.      — ■    is   related 

o  Q 

to  the  finite  differential  dQ  by 

dmT 
dm  =  £="  dQ.  (V-2) 


This  relationship  was  utilized  to  develop  a  procedure  for 
selecting  a  dQ  that  results  in  the  reduction  of  as  many  of 

the  elements,  f  .,  as  possible. 

J 
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The  procedure   for    selecting    dQ  was    incorporated    in   an 

iterative   algorithm    that   attempts    to  select   a   weighting 

matrix   Q   that   minimizes    each   design-measure   difference,    f  .. 

J 

The  algorithm  was    tested   on    three   examples,    two   second- 
order    systemsand   one   third-order    system.      These   tests   were 
carried  out    on    the   IBM    36O-67   computer    system   operating    in 
a    time-sharing   mode.      Operation    in    this   mode   was   mandatory 
due    to   the   subjective    decisions    that   are   required  by   the 
procedure   for    selecting    dQ. 

Computer    CPU   time   for    the    third-order    example  was    approxi- 
mately   91.3   minutes.      It    should  be   noted   that    this    time    in- 
cludes  many   calculations    that   were  made   solely    to   check   out 
the   algorithm.      A   designer    who  was   reasonably   familiar    with 
this    algorithm   should   require   no   more    than    one- third   that 
time   to   develop   an   acceptable   design   for    a    third-order 
s  y  s  t  em . 

The   tests    indicate   that    the  procedure  for    selecting   dQ 

is    a    valid   extension   of   Equation    (V-2),    and   does    lead   to  a 

reduction    in    the    elements    f  .    in   a    neighborhood   of    the   Q   in 

question.      The   test   further    indicates    that    the  algorithm   does 

lead   to   a   minimization   of    the   elements    f  .,    for    a    third-order 

J 

system,  if  the  number  of  elements,  m.,  used  in  the  selection 

procedure  for  _dQ  is  alternated  in  a  judicious  manner  between 

one,  two  and  three.   Consideration  must  be  given  to  the 

dm  . 
relative  magnitudes  of  the  various  sensitivities,  ijJ    , 

i  =  1,  2,...,n,   j  =  1,2,...,L,  and  to  the  current  values 

of  m  so  that  needless  and  useless  computation  is  avoided. 
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The  algorithm   developed    in    Chapter    III,    modified   by    the 
consideration    discussed  above,    appears    to  be   a    feasible  pro- 
cedure  for    use    in    designing    optimal    controls    for    first-, 
second-,    and   third-order    linear    regulations.      An    extension 
of    the   algorithm   to   linear    tracking    systems    can   be   readily 
made. 

The    extension    of    the   algorithm    to    higher-order    systems 
should    be   limited    in    feasibility    only   by    the   computer    time 
required   to    integrate   large-order    systems    of   differential- 
equations.       The    selection   procedure    for    dQ   developed    in 
Chapter    III    applies    for    n      -order    systems,    provided    that 
the    number    of   design    measure    elements    is    less    than    or    equal 
to    n+1 .       This   presupposes    that    the  L    hyper surf aces    in    n- 
dimensional    Q-space,    corresponding    to    the    elements    of   m    , 
have   a    common    intersection. 

It    is    felt    that    further    testing    of    the   algorithm   should 
be   undertaken    before    incorporation    in    a    general    design   pro- 
cedure.      This    testing    should    include    higher-order    systems    and 
different    combinations    of    design    measures. 

A  possible    direction    for    future   research   concerns    a    time- 
varying   weighting    matrix,    Q( t ) .       A    less    time-consuming    inte- 
gration   scheme,    such   as    on    a    hybrid   analog-digital    computer, 

could   make   the    evaluation    of    the   state- trajectory    sensitivity, 

dx 

-r— ,    feasible   for    higher-order    systems.       It    seems    reasonable    to 
oQ 

dx 
assume  rrr   could    be    used    to   adjust    the   weighting    matrix,    Q(t), 

to   reduce    the   absolute    difference   between    the    elements    of    the 

state    vector    and   those   of    a    desired   state    vector. 
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